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ABSTRACT 



This paper provides an evaluator's perspective on the main 
activities and lessons learned from the evaluation of Alliance* in the 
program's first year of operation. The Alliance* project is a national 
training program funded by the U.S. Department of Education with 
contributions from project partners and the participating school systems. The 
program's goal is to provide hands-on training for K-12 teachers to integrate 
the Internet resources into their classroom curricula and improve science and 
mathematics education. The program uses a two-tiered model in which community 
college faculty train cadres of educators (mentor teachers) in the 30-hour 
graduate course. Evaluation criteria and first-year findings are presented 
for each component of the logic model used to build the program. These 
components were: (1) Internet connectivity and access; (2) training course 

and curriculum; (3) specific curriculum models to integrate technology into 
the classroom; (4) mentoring and support; (5) structural changes; and (6) 
trained teachers. Findings are based on site visits, a teacher questionnaire 
completed by 96 teacher mentors, and focus groups of teachers. The first-year 
evaluation has produced a number of significant findings that are being used 
to improve the program and extend its activities. (Contains 2 figures and 25 
references.) (SLD) 
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The Alliance + project is 

(A) a science education project. 

(B) a technology-in-education project. 

(C) a professional development project. 

(D) a school reform and improvement project. 

(E) all of the above. 



Lessons Learned From the Evaluation of Alliance + : An Internet-in-Education Professional 

Development Program 

Mario Yepes-Baraya 
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Introduction 

This paper provides an evaluator's perspective on the main activities and lessons learned 
in the evaluation of Alliance+ for the period October 1998-December 1999, corresponding to the 
first year of operation of the project. First, an overview of the project is presented. Second, the 
evaluation framework and main findings to date are discussed. Finally, a summary, conclusions, 
and recommendations for future activities related to the evaluation of Internet-based projects is 
offered. 



Given the wealth of information resources for education and high degree of interactivity 
provided by the Internet, there exists the expectation that, well used, the Internet has the potential 
to improve learning for all children. There is, however, little data to substantiate these 
expectations on a large scale. The evaluation of the Alliance+ project offers a unique opportunity 
to assess the extent to which the Internet can be an effective tool to significantly improve teaching 
and enhance learning. Although Internet use in the classroom is a rather recent phenomenon, the 
implementation of the Alliance+ project has benefited from the experiences gained over the past 
ten years by the Center for Improved Science and Engineering Education (CIESE) at Stevens 
Institute of Technology with the Alliance project, a precursor of Alliance+, the New Jersey 
Networking Infrastructure for Education (NJNIE) project, and other professional development 
initiatives to help teachers integrate information technology in the classroom. Similarly, the 
evaluation of Alliance+ has gained from the experiences of Educational Testing Service in the 
evaluation of the two projects mentioned above and other professional development projects as 
well. The lessons learned in the context of the Alliance+ project are thus an important 
contribution to the improved understanding of the technical, organizational, and informational 
requirements of Internet-based education. 



Overview of the Alliance+ Project 

The Alliance+ project is a national training program funded by the U.S. Department of 
Education, with significant financial contributions from project partners and the participating 
school systems. The program' s goal is to provide hands-on training for K-12 teachers to 
integrate the Internet resources in their classroom curricula and improve science and mathematics 
education. The project is a joint effort of the Center for Improved Engineering and Science 
Education (CIESE) at Stevens Institute of Technology in New Jersey, the Polaris Career Center in 
Ohio, the League for Innovation in the Community College in California, three community 
colleges (Cuyahoga Community College in Ohio, Miami-Dade Community College in Florida, 
and Maricopa Community College in Arizona), other partners, and the participating school 
systems in Cleveland, Miami and Phoenix. 

The training program is being implemented using a two-tiered model in which 
community college faculty (Core Team Trainers) train cadres of educators (Mentor Teachers) in 
the 30-hour graduate- level course. These mentors then train classroom teachers (Mentee 





